Genetic Algorithm Based Deep Learning Neural Network Structure and Hyperparameter Optimization
نویسندگان
چکیده
Alzheimer’s disease is one of the major challenges population ageing, and diagnosis prediction through various biomarkers key. While application deep learning as imaging technologies has recently expanded across medical industry, empirical design these very difficult. The main reason for this problem that performance Convolutional Neural Networks (CNN) differ greatly depending on statistical distribution input dataset. Different hyperparameters also affect convergence CNN models. With amount information, selecting appropriate parameters network structure became a large research area. Genetic Algorithm (GA), popular technique to automatically select high-performance architecture. In paper, we show possibility optimising architecture using GA, where its search space includes both configuration hyperparameters. To verify our Algorithm, used an amyloid brain image dataset diagnosis. As result, algorithm outperforms by 11.73% given classification task.
منابع مشابه
Optimization of Plastic Injection Molding Process by Combination of Artificial Neural Network and Genetic Algorithm
Injection molding is one of the most important and common plastic formation methods. Combination of modeling tools and optimization algorithms can be used in order to determine optimum process conditions for the injection molding of a special part. Because of the complication of the injection molding process and multiplicity of parameters and their interactive effects on one another, analytical...
متن کاملCMA-ES for Hyperparameter Optimization of Deep Neural Networks
Hyperparameters of deep neural networks are often optimized by grid search, random search or Bayesian optimization. As an alternative, we propose to use the Covariance Matrix Adaptation Evolution Strategy (CMA-ES), which is known for its state-of-the-art performance in derivative-free optimization. CMA-ES has some useful invariance properties and is friendly to parallel evaluations of solutions...
متن کاملA Genetic Algorithm Based Variable Structure Neural Network
This paper presents a neural network model with a variable structure, which is trained by genetic algorithm (CA). The proposed neural network consists of a Neural Network with a Node-to-Node Relationship (PR) and a Network Switch Controller (NSC). In the N'R, a modified neuron model with two activation functions in the hidden layer, and switches in its links are introduced. The NSC controls the...
متن کاملGradient-based Hyperparameter Optimization through Reversible Learning
Tuning hyperparameters of learning algorithms is hard because gradients are usually unavailable. We compute exact gradients of cross-validation performance with respect to all hyperparameters by chaining derivatives backwards through the entire training procedure. These gradients allow us to optimize thousands of hyperparameters, including step-size and momentum schedules, weight initialization...
متن کاملThe hybrid approach based on genetic algorithm and neural network to predict financial fraud in banks
Audit has become an essential topic in the world because there is much evidence about deliberate manipulations in the reports. One of the concerns in the field of audit is discovery and search of the financial statements and the high volume of bulk data. This study tried to suggest the appropriate method to detect these frauds due to the data which has been available and a proposed algorithm. R...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied sciences
سال: 2021
ISSN: ['2076-3417']
DOI: https://doi.org/10.3390/app11020744